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I. INTRODUCTION 



We present a short derivation and discussion of the master equation for an open quantum system weakly coupled 
to a heat bath and then its generalization to the case of with periodic external driving based on the Floquet theory. 
Further, a single heat bath is replaced by several ones. We present also the definition of heat currents which satisfies 
the second law of thermodynamics and apply the general results to a simple model of periodically modulated qubit. 
The text is based on [l| - [j| but contains also new results. 

II. THERMAL GENERATORS FOR CONSTANT HAMILTONIAN 

Consider a system and a reservoir (bath), with a "bare" system Hamiltonians H° and the bath Hamiltonian H R , 
interacting via the Hamiltonian XHi nt = XS <E) R- Here, S (R) is a Hermitian system (reservoir) operator and A is the 
coupling strength ( a generalization to more complicated Hint is straightforward). We assume also that 

[p R ,H R ] = 0, Ti(p R R) = 0. (1) 

The reduced, system-only dynamics in the interaction picture is defined as a partial trace 

p(t) = A(t,0)p = Tr R (U x (t,0)p® p R U x (t,0y) (2) 

where the unitary propagator in the interaction picture is given by the ordered exponential 

■ \ ft 

Ux(t,0) = Texp{^-y S(s)®R(s)ds} (3) 

where 

S(t) = e {l/h)m Se {l/h)H \ R(t) = e {l/h)Hlit R e - {i/h)HRt . (4) 

Notice, that S(t) is defined with respect to the renormalized, physical, H and not H° which can be expressed as 

H = H° + A 2 if™" + • • • . (5) 

The renormalizing terms containing powers of A are Lamb-shift corrections due to the interaction with the bath 
which cancel afterwards the uncompensated term H — H° which in principle should be also present in ([3]) . The lowest 
order (Born) approximation with respect to the coupling constant A yields ff^ orr , while the higher order terms (• • • ) 
require going beyond the Born approximation. 

A convenient, albeit not used in the rigorous derivations, tool is a cumulant expansion for the reduced dynamics 

oo 

A(i,0) = ex P ]T[A»if (">(*)], (6) 

n=l 

One finds that K^- 1 ' — and the Born approximation (weak coupling) consists of terminating the cumulant expansion 
at n = 2, whence we denote K ^ = K: 

A(i, 0) = exp[A 2 A-(t) + 0(A 3 )]. (7) 

One obtains 

K(t)p =-L I ds ( duF(s - u)S{s)pS(v,y + (similar terms) (8) 
" Jo Jo 
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where F(s) = Tt(prR(s)R). The similar terms in Eq. <j8j) are of the form pS(s)S(uy and S(s)S(uY p. 

The Markov approximation (in the interaction picture) means in all our cases that for long enough time one can 
use the following approximation 

K(t) ~ tC (9) 

where C is a Linblad-Gorini-Kossakowski-Sudarshan(LGKS)- generator. To find its form we first decompose S(t) into 
its Fourier components 

S{t) = ^2e*^S u ,S- u =Sl (10) 
M 

where the set {cj} contains Bohr frequencies of the Hamiltonian 

H = Y,ek\k){k\, LU = e k -ei. (11) 

Then we can rewrite the expression © as 

i ft rt — u 

K(t)p= —Y^S^pSl e^-^du F(T)e luJT dT + (similar terms). (12) 
and use two crucial approximations: 

t rt — U pOC 

e^-^du^tSw, / F( T )e iUT dTttG(u)= F{r)e lulT dr >Q. (13) 

J —u J — oo 

This makes sense for t 3> max{l/(o; — lu')}. Applying these two approximation we obtain K{t)ps — 
(t/^ 2 )J2uj ^PsSl,G(uj) + (similar terms), and hence it follows from Eq. ((9|) that £ is a special case of the LGKS 
generator. Returning to the Schroedinger picture one obtaines the following Markovian master equation: 

c p = ^E^Ha^psii + ^p,^]) (14) 

Several remarks are in order: 

(i) The absence of off-diagonal terms in Eq. (fT4)) . compared to Eq. p2|) . is the crucial property of the Davies generator 
which can be interpreted as a coarse-graining in time of fast oscillating terms. It implies also the commutation of C 
with the Hamiltonian part [H, •]. 

(ii) The positivity G(cj) > t follows from Bochner's theorem and is a necessary condition for the complete positivity 
of the Markovian master equation. 

(iii) The presented derivation showed implicitly that the notion of bath's correlation time, often used in the literature, is 
not well-defined - Markovian behavior involves a rather complicated cooperation between system and bath dynamics. 
In other words, contrary to what is often done in phenomenological treatments, one cannot combine arbitrary H 's with 
a given LGKS generator. This is particularly important in the context of thermodynamics of controlled quantum open 
system, where it is common to assume Markovian dynamics and apply arbitrary control Hamiltonians. Erroneous 
derivations of the quantum master equation can easily lead to violation of the laws of thermodynamics. 

If the reservoir is a quantum system at thermal equiliubrium state the additional Kubo-Martin-Schwinger (KMS) 
condition holds 

G(- W ) = exp(-^)G( W ), (15) 
where T is the bath's temperature. As a consequence of (13T))) the Gibbs state 

pp = Z~^ H , P = t^ (16) 
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ia a stationary solution of (fl4|) . Under mild conditions (e.g : "the only system operators commuting with H and S 
are scalars" ) the Gibbs state is a unique stationary state and any initial state relaxes towards equilibrium (" 0-th law 
of thermodynamics"). A convenient parametrization of the corresponding thermal generator reads 

£P=1 E 7M{([^,pS+] + [ 1 5 w p,5i]) + e -^([5t ) p5J + [ 1 5ip,5 w ])} (17) 

{w>0} 

where finally 

\2 f+oo 

tH=«/ ^{pRe iHRt/h Re- iHRt ' h R)dt. (18) 



III. THERMAL GENERATORS FOR PERIODIC DRIVING 



In order to construct models of quantum heat engines or powered refrigerators we have to extend the presented 
derivations of Markovian master equation to the case of periodically driven systems. Fortunately, we can essentially 
repeat the previous derivation with the following amendments: 

1) The system (physical, renormalized) Hamiltonian is now periodic 

i f* 

H(t) =H(t + r), U(t,0) =Texp{-- / H(s)ds}, (19) 

" Jo 

and the role of constant Hamiltonian is played by H defined as 

H = ^e k \k)(k\, U(T,0)=e- im /\ (20) 
k 

2) The Fourier decomposition (fTUf is replaced by the following one 

U(t, 0)t S U(t, 0) = E e i{u,+gn)t S uq , (21) 

g£Z {lj} 

where fl = 2tt/t and {uj} = {efc — e{\. The decomposition of above follows from the Floquet theory, however for many 
models we can obtain it directly using the manifest expressions for the propagator U(t, 0). 

3) The generator in the interaction picture has form: 

qEZ {ui} 

where 

c uqP = i 7 ( w + qn){([s uq , P st q } + [Suip, sl q ]) + e-^+^His^pS^} + [st qP , s uq ])}. (23) 

Returning to the Schroedinger picture we obtain the following master equation: 

^ = ~[H(t),p(t)]+C(t)p(t)t > 0, (24) 

where 

C(t) = C(t + t)= U(t, 0)£U(t, 0) f , U{t, 0)- = U{t, 0) • U(t, 0) f . (25) 

In particular one can represent the solution of (|24|) in the form 

p(t) =U(t,0)e ct p(0) ,t > 0. (26) 

Any state, satisfying Lp = 0, defines a periodic steady state (limit cycle) 

p(t)=K(t,0)p = p(t + T) ,t>0. (27) 

Finally one should notice that in the case of multiple couplings and multiple heat baths the generator C can be always 
represented as an appropriate sum of the terms like (|17l) . 



4 



A. Heat flows and power for periodically driven open systems 

To derive the laws of thermodynamics in the case of an arbitrarily fast periodic modulation we start with the 
proper definition of heat currents which reproduces the II-law as one expects that the coarse-grained dynamics should 
satisfy it exactly. The constant (interaction picture) generator can be written as a sum over M independent baths 
contributions, the harmonics {gil} and Bohr quasi-frequencies {w} 

M 

£ = EE E 4-. (m) 

j=l q£Z {ui>0} 

where 

4uP= E (l%\u + <lto){[Si(q,v)p,S k (q,wN + h.^ (29) 
k,ieij 

Here, the notation (x) reflects the assumption of M-independent heat baths which leads to the decomposition 

of the matrix Rm{x) into blocks {i2jy , k, I £ Ij}, each corresponding to the j-ih heat bath and satisfying the Kubo- 
Martin-Schwinger condition in the form 

R${-x) = e- x ' kBT ifi$(x) , k,lslj. (30) 

Notice, that a single component is also a LGKS generator and possesses a Gibbs-like stationary state (stationarity 
can be proved combining (JToJ) and ((Tol l) 

^ = Z exp ( —k^F^ (31) 

The corresponding time-dependent objects satisfy 

4- (*)&(*) =0, =U(t,0)CyA{t t 0)t, pjjt) =W(t,0)^ = p^ + r) . (32) 



Using the decomposition (|28[) . (129[) one can define a local heat current which corresponds to the exchange of energy 
uj + qfl with the j-th heat bath for any initial state 

J^(t) = -^-Tr[{CP qM {t)p{t))H{t% H(t)=U(t,0)H, (33) 

or in the equivalent form 

Jj u (t) = -k B T 3 Tr[(C^(t)p(t)) Inj^Ct)] . (34) 
The heat current associated with the j-th bath is a sum of the corresponding local ones 

J\t) = -k B T 3 £ E T*[(4- (*>(*)) !*/&,(*))] • (35) 
<?ez {w>o} 

Using Spohn's inequality 

Tr ([jCp][lap -lap]) < (36) 
valid for any LGKS generator £ with a stationary state p, one obtains the II-law in the form 

where S(f) = -AuTr(p(t) lnp(i)). 

The heat currents in the steady state p(t) are time-independent and given by 

Ji = -k B T, E Tl '[(^P) l^J] • (38) 

q£Z {w>0} 
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They satisfy the II-law in the form 



while, according to the I-law 



M qi 

£^<o ( 39 ) 



A I 



-J = V (40) 



is the averaged power (negative when the system acts as a heat engine). Notice, that in the case of a single heat bath 
the heat current is always strictly positive except the case of no-driving when it is equal to zero. 



IV. THE EXAMPLE. QUBIT WITH THE DIAGONAL MODULATION 



We apply the results of the previous Section to particularly simple model of a qubit with diagonal time-dependent 
Hamiltonian 

H(t) = ^uj{t)<j 3 , ui(t + t) = ui{t). (41) 

A qubit is coupled to two independent heat bath (hot and cold) at the temperatures T /l ,T c , respectively , by the 
interaction Hamiltonian 

H int = a 1 ®(B h +B c ). (42) 
Because of the diagonal form of H(t) the Floquet formalism of above drastically simplifies due to 

i r 

F(t) = F(0) = exp{— iwotct 3 /2} , LJ = - / u(t)dt. (43) 

T Jo 

The master equation for the density matrix of TLS has form (notice time-independence of the dissipative part) 



dp(t) 



dt 2 

Here, putting a = c, or a = h we have 



= -, l -uj{t)[a\p{t)]+C c p{t)+L h p{t). (44) 



where 



Here 



£ a P = J2 C > ( 45 ) 



£ a q P = ^ (G>o + qtt)([<r-p, <J + ] + [cT-,pa + ]) + G a (-c - q n){[a+p, a'} + [a+, pa'})) (46) 



G a {uj)= I e luJt (B a (t)B a )dt^e UJ / kBTa G a (~u). (47) 

J — oo 

and the probability distribution P(q) is given by 

P(l) = IC(?)| 2 , = - / e l ti^- u ^ ds e lqnt dt. (48) 



T 



Notice that the dynamics (|4"4"]) transforms the diagonal elements into diagonal ones and the stationary states are also 
diagonal. The decomposition of the generators (|46|) into harmonic components leads to the picture of the periodically 
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driven qubit in a steady state as equivalent (in a certain sense) to a qubit with a time-independent Hamiltonian 
H Q = uj a 3 /2 coupled to two sequences of "effective heat-baths" with the "temperatures" 

T a (q)= - n T a , a = c,h. (49) 

Notice that the effective temperatures can be positive or negative. However, the equivalence is restricted to the form 
of the stationary states p a q and p 

^= z -.(„, 9 ,exp(-*j5_) • ^^M-iSty (50) 

where 

and the averaged decay rate from the excited state and the excitation rate from the ground state read 

R e = E P (9)G a (^o + qty , R a g = P(q)G a {-^ - qSl). (52) 
qez q ez 

On the other hand the "single-harmonic current" has form 

^ = 7^) Tr [( £ ^)^)] = i 1 ^)^ q P)Ho)} (53) 

which differs by the factor from the heat current related to a heat bath coupled to a system with the Hamiltonian 
H - Due to this modification the total heat current equal to minus power is generally different from zero in contrast 
to the case of absent modulation. 

For the special case of the modulation in a form of two alternating pulses per period 

w(t) = uj + TT ^ (S(t -(q+ 1/4)) - S(t -(q + 3/4))) . (54) 
qez 



we obtain 



P 2n = , P ( 2n + 1) = -i__L—, n = 0,l,2,.... (55) 
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